METHOD, SYSTEM AND COMPUTER PROGRAM PRODUCT FOR 
CLASSIFYING PACKET FLOWS WITH A BIT MASK 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the benefit of U.S. Provisional Application 

Serial No. 60/264,065, filed January 26, 2001, by Merugu et ah, entitled 
"Method, System and Computer Program Product for Classifying Packet 
Flows with a Bit Mask," incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0002] The present invention is directed to controlling network transmissions. 

More particularly, the present invention relates to classifying data packets in 
an internetworking environment. 

Related Art 

[0003] As network infrastructure is being geared to support newly enhanced 

services, an evolution in the mechanisms that are used to handle traffic in 
networks can be observed. Packet switching introduces the task of routing a 
packet (i.e., EP datagram or protocol data unit (PDU)) based on its destination 
address. This task was simple in the past, not only because of the low volume 
of traffic, but also because there was only a need to examine only one 
dimension (i.e., field) in a packet header. As networks continue to evolve, the 
task of packet routing will became even more complex with the need for 
policy-based routing, access-control in networks, traffic accounting and 
billing, support for quality of service, per-flow computation in active 
networks, and the like. 

[0004] All the mechanisms that achieve packet routing today can be 

categorized broadly into a problem domain called "classification of packets." 
The key idea in packet classification is to find a best fit among a set of rules, 
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where each rule describes a class of packets. A subsequent operation is to 
perform the action associated with the best-fit rule. However, as suggested, 
several factors render conventional packet classification techniques 
ineffective. For instance, as the set of rules increases in size, more memory 
space is required to search and identify the appropriate rule that matches an 
incoming packet. Additionally, the dimensions of search space for identifying 
a rule are directly proportional to the number of fields supported in a rule. 

[0005] Another challenge to efficient packet classification involves the 

hierarchy of protocol headers. If the data traffic includes multiple patterns of 
protocol headers (e.g. [Ethernet+IP+TCP], [Ethernet+IP+UDP], and 
[Ethernet* ARP]), it is imperative to identify the correct pattern of protocol 
headers before applying the rule-matching function. 

[0006] Conventional packet classification methodologies are also impaired by 

frequent rule changes. In other words, the rule set typically changes or is 
updated during due course. Dynamically varying rule sets grant a packet 
classifier with very little time to examine or optimize the rule set database. A 
rule-set database is usually pre-processed and stored in optimal data structures 
for fast access. The pre-processing stage has a trade-off between time and 
memory consumption. Good optimizations can result from highly compressing 
the rule-set, but take a long time. Moreover, the faster the packet arrivals, the 
shorter the time the packet classifier has to classify a single packet. 

[0007] An example of a multiple-field packet classification is a firewall. 

Firewalls usually have a small set of rules based on the policy of an 
organization. Firewall rules are quite general in terms of the number of kinds 
of packets it describes. The more general a rule, the larger the number of 
packets that match it. For example, a more general rule would have fewer 
fields per rule, and more wildcards or ranges for its fields. On the other hand, a 
more specific rule could have large number fields with each field represented 
by a singleton value. The generality of a rule has an implicit inverse relation 
with the cardinality and variation of the rule set. 
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[0008] Nonetheless, unlike firewalls, a flow-classifier table has a large set of 

rules with each rule spanning over many fields. A flow-classifier rule table is 
updated whenever a new flow is instantiated or an old flow is discarded. The 
frequency of flow creation or deletion is orders of magnitude higher than the 
rate of variation of a firewall table (i.e., firewall tables are updated when 
policies are revised). 

[0009] Consequently, a system and method are needed to solve the above- 

identified problems and provide a simple, efficient and cost-effective way to 
classify packets in a dynamic environment. 

SUMMARY OF THE INVENTION 

[0010] The present invention provides a system and method for packet 

classification that is based on the use of a hash function that extracts bits using 
a mask. A relatively small set of bits is selected to uniquely identify the 
packets satisfying a packet classification rule. 

[0011] In an embodiment, the mask is constructed by evaluating each field 

description or location in a rule set in multiple iterations. In each iteration, an 
optimal location is determined based on a metric that measures the partition of 
the rule set into subsets. The number of locations selected for the mask is 
based on the original size of the rule set and collision control parameters. 

[0012] The mask is used to refine the rule set to a form that is easily 

accessible later for packet classification. An automated learning process is 
implemented to build and update the original rule set and/or refined rule set, 
based on incoming packets. Changes to the 7 rule sets are handled on-line via a 
fast update mode that adds to the refined rule table, while a background 
process performs re-optimization of the original or full rule table less 
frequently. 
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BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES 



[0013] The accompanying drawings, which are incorporated herein and form 

part of the specification, illustrate the present invention and, together with the 
description, further serve to explain the principles of the invention and to 
enable a person skilled in the pertinent art to make and use the invention. In 
the drawings, like reference numbers indicate identical or functionally similar 
elements. Additionally, the leftmost digit(s) of a reference number identifies 
the drawing in which the reference number first appears. 

[0014] FIG. 1 illustrates a packet classification system according to an 

embodiment of the present invention. 

[0015] FIG. 2 illustrates an operational flow diagram for constructing an 

extraction function according to an embodiment of the present invention. 

[0016] FIG. 3 illustrates a multiplexor according to another embodiment of 

the present invention. 

[0017] FIG. 4 illustrates a rule set division tree according to another 

embodiment of the present invention. 
[0018] FIG. 5 illustrates a search tree according to another embodiment of the 

present invention. 

[0019] FIG. 6 illustrates an operational flow diagram for classifying a packet 

according to an embodiment of the present invention. 
[0020] FIG. 7 illustrates a bit extraction key according to another embodiment 

of the present invention. 
[0021] FIG. 8 illustrates an operational flow diagram for classifying a packet 

according to another embodiment of the present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

[0022] Generally, objects are described by their features. Applications that 

have to learn about a large data set of objects tend to pick those features that 
are relevant and discard those that are redundant. Many such applications can 
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be found in literature, especially in databases, and artificial intelligence. This 
approach of reducing the dimensionality of search space by removing 
irrelevant features is called "Feature Selection," as discussed by M. Dash and 
H. Liu in "Feature Selection Methods for Classification: A survey," Technical 
Report, Department of Information Systems and Computer Science, National 
Institute of Singapore, (1999). 

[0023] Feature selection can be used to learn about huge data sets, especially 

to classify objects based on prominent features. The method and system of the 
present invention apply feature selection to the context of packet 
classification. Since packet classification involves rules that describe packet 
headers, a feature for packet classification can be a "field", as in a protocol 
header, or a "chunk of bits", independent of protocol header structure. If using 
chunk of bits, a subset of bit locations must be selected such that the bits 
extracted from these locations represent the entire data set. 

[0024] In an embodiment of the present invention, a data set comprises of M 

bit vectors each of size k bits. A subset / out of k bit locations {bi, b 2 ,... 3 b*} 
are selected such that the bits in these / locations for all M bit vectors best 
represent the entire data set. Subsequent changes to the data set can be easily 
accommodated by adding or deleting the representative bits in subset / 
locations. In an embodiment, the subset is built by using a hash function H, 
that can be represented as an /-tuple (pi, p2,.- ? P/), where pi denotes a bit 
location. 

[0025] The selection of the bit locations depends on the original data set of M 

bit vectors. Moreover, the process of reducing the bit vectors from size k to 
size / can be expressed as a projection of M points in k dimensional space onto 
smaller / dimensional space. It is important to note that this process - of vector 
projection can project multiple points in k dimensional space to a single point 
in / dimensional space. Such projection of multiple points in higher 
dimensions to a single point in lower dimension is referred to as being a 
collision. Accordingly, the methods of the present invention seek to minimize 
collisions, ideally to none, by selecting the right set of / bits. Thus, the packet 
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classification system and method of the present invention reduce k dimensions 
to just / dimensions. 

[0026] FIG. 1 illustrates packet classification system 100 according to an 

embodiment of the present invention. System 100 includes a policy engine 
102, primary rule memory 104, mask constructor 106, refined rule memory 
108, key extractor 110, and packet classifier 112. Policy engine 102 stores the 
appropriate network rules and policies for classifying packets. Periodically, 
policy engine 102 sends updated lists of the rules to primary rule memory 104 
and refined rule memory 108. In an embodiment, the updating occurs offline. 
In another embodiment, the rules are dynamically updated in real time or near 
term. 

[0027] Mask constructor 106 receives or queries primary rule memory 104 for 

relevant rules and generates an extraction function. In an embodiment the 
extraction function is a hash function, in particularly a bit mask. The 
extraction function is sent to key extractor 110 that uses the extraction 
function (e.g., bit mask) to partition, index and/or categorize the rules located 
in primary rule memory 104. The rules, after being processed by key extractor 
110, are stored in refined rule memory 108 for subsequent queries related to 
the operation of packet classifier 1 12. 

[0028] Key extractor 110 also receives packets from across a network 

connection, which includes wired or wireless local area networks (LAN) or 
wide area networks (WAN), such as an organization's intranet, the global- 
based Internet (including the World Wide Web (WWW), or the like. Key 
extractor 110 applies the extraction function to create a packet key that is sent 
to the packet classifier 112. Packet classifier 112 uses the packet key to 
identify a rule that matches the incoming packet. 

[0029] Thus, packet classification system 100 handles the creation and 

maintenance of primary rule memory 104 and refined rule memory 108, and 
the construction of the extraction function used by key extractor 1 1 0 to form a 
packet key from an incoming packet. In other words, primary rule memory 
104 and refined rule memory 108 contain a set of classification rules, and an 
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extraction function is produced by mask constructor 106 to refine the rules in 
primary rule memory 104 to a form that is easily accessible later for packet 
classification. The refined rules are stored in refined rule memory 108. 

[0030] Although the extraction function can be designed to produce accurate 

results from a fixed or stochastic data set, it can be challenging to design an 
extraction function that fits a dynamically changing data set to produce 
accurate results all the time. Since the rule set typically varies dynamically, 
mask constructor 106 generates, in an embodiment, a flexible hash function. In 
other words, the present invention uses a hash function whose operational 
parameters can be dynamically tuned in response to changes in the rule set. 

[0031] Although in an embodiment, the hash function created by mask 

constructor 106 is based on a bit mask, other extraction functions that meet the 
flexibility criteria can be used. The primary objective is to select, from a rule 
set, the best subset of / bit locations out of k possible locations. The goodness 
of fit for a subset can be measured in terms of the quantity of unique rules 
identified by examining the / bits. In other words, the extraction function is an 
optimization model that seeks to minimize the number of collisions when the 
dimensions are reduced. 

[0032] System 100 includes a three-phase integrated control process to refine 

a rule set. First, policy engine 102 updates primary rule memory 104 with the 
pending request queue operations. In an embodiment, a request queue (not 
shown) is used to store all add and delete operations on primary rule memory 
104 or refined rule memory 108. Secondly, mask constructor builds a hash 
function that best fits the rule set within primary rule memory 104. Finally, 
key extractor 110 runs the extraction function through all rules within primary 
rule memory 102 to create a refined rule set that is stored in refined rule 
memory 108. 

[0033] In an embodiment, a simple heuristic model is used to create the 

extraction function. Heuristic-based extraction functions can be classified into 
two types: those that make use of class information about the data and those 
that do not use class information. 
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[0034J As an example of heuristic model that utilizes class information or 

empirical knowledge, mask constructor 106 constructs an extraction function 
that takes into consideration that the bits for an Ethernet Protocol field are 
rarely different from that of a value for ETHERNET_PROTOJP, and on the 
other hand, the bits corresponding to the fourth byte of an IP address vary 
substantially. So, the extraction function would select the more highly variable 
bits as the likely candidates that can uniquely identify a rule. 

[0035] Mask constructor 106 can also construct an extraction function that 

does not make use of any class information. For example, the extraction 
function could count the number of l's and 0's in each bit location across all 
rules and select those locations where these numbers are close to Mil, where 
M is the number of rules. 

[0036] In another embodiment, an analytical model is used as the extraction 

function to compute metrics at different stages. This group of extraction 
functions can be divided into three types. The first type considers each bit 
location in isolation and ranks the bit locations according a specified metric. 
The extraction function would remove the bit location/dimension and examine 
the quality of the data that is left behind. For example, the quality of data can 
be interpreted as information entropy. The higher the quality, the more 
irrelevant the bit location is considered to be and the lower the bit location 
would be ranked. After ranking the bit locations in descending order, the 
extraction function would choose 1 best locations as the output subset. 

[0037] A second type of analytical-based extraction functions is one that lists 

all the possible subsets of bit locations exhaustively and measures a metric for 
each listed item. 

[0038] The third analytical-based extraction function is a hybrid of the first 

two types. At every stage of implementation, the extraction function maintains 
a current chosen subset of j (j < J) bit locations and tries to pick the best one 
from the rest to increment the subset. As an invariant, the extraction function 
ensures that the currently chosen subset of j locations is the best subset at 
present. Otherwise, the extraction function backtracks to the previous 
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(smaller) subset. The extraction function recomputes the rank of the rest of the 
bit locations at every stage. This process repeats until the size of the chosen 
subset has increased to / bit locations. In other words, the extraction model 
uses a greedy algorithm to locally optimize at every stage. Although this 
extraction function is more complex than the extraction function that simply 
selects bits-in-isolation (i.e., the first type), it has more intelligence and is 
highly likely to result in the optimal solution. 
[0039] Referring to FIG. 2, flowchart 200 represents the general operation 

flow of an embodiment of the present invention. More specifically, flowchart 
} -& 200 shows an example of a control flow for developing a tree-like data 

P structure, and constructing an extraction function that utilizes the data 

V* structure. As described in greater detail below, the tree-like data structure 

13 

* 4 comprises an original rule set, or root, that is subsequently partitioned into 

in 

\ y multiple subsets or nodes. Each time a node, or subset of rules, are partitioned, 

the data structure is deemed to have increased in depth. The node at the final 
M depth is the leaf node, and the quantity of rules within a leaf node is referred to 

'if* as the bucket size. 

13 [0040] Referring to FIG. 2, the control flow of flowchart 200 begins at step 

fU 

203 and passes immediately to step 206. At step 206, threshold parameters are 
established for controlling the process. In particular, the threshold parameter 
defines the certain aspects of the data structure and the resulting properties of 
the extraction function. In an embodiment, a bucket size threshold is specified 
to stipulate the maximum number of rules permitted in each leaf node. It is 
preferable to keep the bucket size small to mitigate the possibility of collisions 
and improve system performance. Accordingly, the bucket size can be one or 
more rules depending on the size of the original set of rules, memory capacity, 
processor speed, and various other system characteristics. The initial size of 
the rule set varies in each situation. If system 100 supports well known packet 
types, the rule set would contain a list of these types. If nothing is known 
about the packet types in the network or internetworking environment, system 
100 could start with an empty rule set and build up as packets arrive. 
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[0041] In another embodiment, a depth threshold is specified to stipulate the 

maximum number of iterations that the rules are to be processed and/or 
partitioned, without regard to bucket size. The depth threshold can be a 
function of the size of the original set of rules, memory capacity, processor 
speed, and various other system characteristics. The depth threshold also 
determines the number of index positions to be accorded to the extraction 
function upon completion of its construction. 

[0042] In another embodiment, both bucket size and depth threshold 

parameters are stipulated. In this embodiment, the rules are processed until 
either the stipulated depth or bucket size is reached for all nodes. 

[0043] At step 209, the partitioning process is initiated to construct the 

extraction function. Mask constructor 106 starts with the entire set of 
classification rules, each of size k bits, that reside in primary rule memory 104. 
Mask constructor 106 analyzes each field descriptor, or bit location, until an 
optimal location is selected as the first location or index key in the extraction 
function. 

[0044] At step 212, the process is repeated until the stipulated threshold is 

reached. At each iteration, mask constructor 106 selects a new location, such 
that the rule set at the previous level is divided into two siblings or subsets 
(one subset of rules with a zero in that chosen location, while the other subset 
of rules has a one in the same location) at the next level. The choice of 
location is based on maximizing the division of all the sets of rules from the 
previous level. The extent of the division of a single set is measured in terms 
of difference in cardinality of the siblings at the next level. In other words, the 
difference in cardinality is measured by computing the total of rules having a 
zero value at a selected location, computing the total of rules having a one 
value at the same location, and measuring the difference. Further, the extent of 
division of all sets put together at a level is captured by taking a sum of these 
individual differences. The smaller the sum, the greater the division. In 
embodiment, the sum of squares of difference in cardinality is used to measure 
the division. A score is computed for each location to measure the extent of 

SKGFRef.: 1875.0360001 



• 



- 11 - 

division, and the location with lowest score is selected. Hence, a common bit 

location is selected among all siblings at each level. 
[0045] At step 215, the selected locations or index keys are assembled as the 

extraction function. The extraction function subsequently is used as a query 

key to query the refined rule set for incoming packets. The control flow, then, 

ends as indicated at step 295. 
[0046] A description of the process, in pseudo code, for selecting bits for an 

extraction function is shown below: 

[0047] SelectBits(RuleSet R, NumBits /, MaxCollisions c) 

{ 

/* R has M rules, each of which is k bits wide */ 

/* This algorithm attempts to select / bits such that the number of 

collisions is less than c */ 

Q «- {ri, r2, . . . , tm} i /* ^ includes all rules from R */ 
K «- {bi, b2, . . . , b M } ; /* K is a set of all bit locations */ 
for each bit location bi e K do 

{ 

Zft «- { Tj | Tj has a zero at bit location bi } ; 
Ofy +- { tj | rj has a one at bit location bi } ; 

} 

/* Note that V bj , Zfe. nOft.= 0 and Zfy u Ob, = Q */ 
S£ «- 0 /* SP is set of bits that are selected so far */ 
d +- 0 /* d is current depth of set division tree */ 
Q 0 «- Q; /* Qo is root of set division tree */ 

divideFlag «- ( | Qo I > c); /* divideFlag indicates whether to 
proceed with set division or not */ 
while ((divideFlag) && (</ < 0) do 
{ 

/* Choose the next bit location */ 
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for each bit location b; e K - SB do 
{ 

Wfc. <- 0; */ Wfc. represents the weight of bit 
location bj in this iteration */ 
for each node Q </ at depth d do 

Wfc. - Wfe. + [|Q^. n Z^,. I - \cidj n 

0*J] 2 

} 

9? «- 92 {b m i n }; /* where Wz? min is minimum of all weights 

in this iteration */ 

for each node Q at depth d do 

addQ^. n Z£>. andQ^. n Oft, as children; 
d «- + 1 ; /* Extending the tree one step deeper */ 
If V Q dj \£2dj \ <c then /* all nodes Q d } at depth d have 

less elements than c */ 

divideFlag <~ FALSE; 
} /* end of while */ 
return S£; /* Return the set of selected bits */ 

> 

[0048] Once optimal bit locations have been selected to build the extraction . 

function, mask constructor 106 sends the extraction function to key extractor 
110. Key extractor 110 used the extraction function to process rules and/or 
packets to extract bit locations. Regarding rules, the extracted locations are 
used to index and/or categorize the rules. Regarding packets, the extracted 
locations are used to develop a lookup key that is used to query or search the 
rules. 

[0049] Hence key extractor 110 contains a bit extraction module that is 

essentially a k x / multiplexor that selects the relevant / bits among the k bit 
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header fields of, for example, a packet. FIG. 3 illustrates an exemplary 
implementation of the multiplexor. In an embodiment, the bit extraction is 
implemented in hardware as a crossbar switch with k inputs and / outputs. The 
/ bit output is the lookup key used to query the rule set. The / bit output is 
directly loaded into a / bit register. The implementation of a crossbar has two 
elements. One is the switching matrix that requires k x / switches. For 
example, a 256 * 64 multiplexor requires 16K switches which can be 
implemented with current Very Large Scale Integration (VLSI) technologies. 

[0050] The second element is the control logic that manages the crossbar. The 

crossbar needs to be reconfigured only when the bit mask changes. Therefore, 
the crossbar control logic does not need to reconfigure the switch matrix in a 
single instruction. Each of the / bit positions can be configured in a sequence. 
Since the reconfiguration of the switch is a low frequency event and is not in 
fast path, the present invention provides a crossbar implementation that is 
simple and real estate efficient. 

[0051] If more delay can be tolerated through system 100, the multiplexor can 

be implemented as a bit shifter. With a bit shifter, key extractor 110 could 
generate the string in k + / clock cycles. This is predicated upon there being at 
least k shift operations and / store operations. However, the bit shifter design 
would limit the packet processing capability to one packet every k + / clock 
cycles. 

[0052] In an embodiment, mask constructor 106 interacts with key extractor 

110 to build an extraction function. As mask constructor chooses each location 
for analysis, key extractor 110 processes the rule set to identify the location 
value (e.g., "0" or "1"). The location value is returned to mask constructor 106 
so that it can measure its cardinality, as discussed above. An example of 
building an extraction function is shown below with reference to Table 1 and 
FIG. 4. 
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Table 1 : Rule Set with 8 Bit Locations 



[0053] Table 1 contains a simple set of (M = 4) rules that have a maximum (k 

= 8) bits each. FIG. 4 illustrates how the rule set of Table 1 is refined by mask 
constructor 106 according to an embodiment of the present invention. Bit 
position 2 divides the set S with four rules {ri, r 2 , r 3 , r 4 } into two subsets: So 
and Si, each with two rules. Next, bit position 8 divides these two sets So and 
Si further into two subsets each. Thus, mask constructor 106 would create four 
subsets Soo; S01; S10; Sn, each of them representing one rule. Accordingly, the 
bit positions or bit locations 2 and 8 are representative of the entire of rules 
set. 

[0054] FIG. 5 illustrates a search tree used in a greedy algorithm to select bits. 

At every iteration, mask constructor 106 lists all possible divisions of subsets 
and chooses the best one based on a weight function. The weight function 
maximizes the set division at a level. Referring back to Table 1, bit position 2 
gives the best weight, in the first iteration, as it divides the set S exactly in 
. half Once a branch is chosen, mask constructor 1 06 continues in that direction 
and ignores the remaining possibilities in search tree, i.e. bit positions 1, 3, 4, 
5, 6, 7 and 8. In the second iteration, the choice of bit position 8 is best 
because it divides the sets from bit position 2 equally. Thus, mask constructor 
106 uses a greedy approach for bit selection. 

[0055] Several observations can be made from the example shown in Table 1 

and FIG. 5. First, the order of bit selection is not important as picking position 
2 and then position 8 is the same as picking position 8 and then position 2. 
Second, the minimum number of bits required to identify the rules uniquely is 



SKGFRef.: 1875.0360001 



• 



- 15 - 

equal to the depth of the tree at which all leaves have singleton sets. Third and 
last, the size of the search tree is large to be able to explore all possibilities in a 
real case. 

[0056] The above examples have been described in reference to a binary 

representation of a rule set. However, the present invention can also be 
implemented in embodiments that use wildcards and ranges. A field descriptor 
or bit location having a wildcard value is capable of being any possible value. 
For example, if an 8-bit field (such as an EP protocol field) has a wildcard, all 
packets that have any of the possible values 0 to 255 match correctly on this 
M field. As a result, each of the 8 bits corresponding to a wildcard field match 

r 3 either a 0 or 1 . Therefore to support wildcards, the rule set follows a ternary 

]U notation (1, 0, *), in which the represents both binary digits "0" and "1." 

''4 Selecting an optimal bit location in such an embodiment necessitates a two- 

m phase analysis. The metric used to measure the extent of partition is a 

:^ weighted average of two parts. The first part computes the evenness of 

I- division of each set, and the second part keeps the average cardinality of 

IQ children at each depth low. The first part ensures the children are almost the 

\f z same size. The second part avoids bit locations with wildcards because they 

lead to duplication of rules. 
[0057] In another embodiment, the present invention supports a field 

descriptor that specifies a range of values instead of just one or all of them. 
For example, a TCP source port descriptor can range from 100 to 200. Thus, 
all packets with values in this range match correctly on this field. A rule with 
ranges having different types needs to be preprocessed into multiple rules such 
that their conjunction maps onto the original rule. The decomposition of a 
single rule into multiple rules can be represented using wildcards in 
appropriate bit locations. For example, assuming a 4-bit field descriptor, a 
range [6,1 1] is decomposed into two sub ranges: [6,7] represented as 01 1* and 
[8,11] represented as 10**. 
[0058] In accord with the present invention, if the length of a range is not a 

power of two, the rule represented by the range must be decomposed into sub 
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ranges. Similarly if the length of a range is a power of two and the lower limit 
is not a power of two, the rule represented by the range must be decomposed. 
Otherwise, if the length of a range is a power of two and the lower limit is a 
power of two, the rule represented by the range does not need to be 
decomposed, and the rule can be processed as a wildcard, as discussed above. 

[0059] An important characteristic of system 100 is the two modes of 

operation: full optimization and fast update. The full optimization mode 
updates primary rule memory 104 and refined rule memory 108 in a global 
sense. As such, policy engine 102 is configurable to fully reconstruct primary 
rule memory 104 or refined rule memory 108 in order to reduce the number of 
collisions. On the other hand, the fast update mode is designed to add rules 
directly to refined rule memory 108 in real time or near term so that the new or 
modified rules can be available as soon as possible. 

[0060] In the fast update mode, policy engine 102 adds a new rule by using 

the current extraction function. The addition of rules could create collisions in 
the refined rule set, and hence, the extraction function stored in key extractor 
110 could lose its optimality. Even though system 100 can operate effectively 
under less optimal conditions, mask constructor 106 is configurable to 
reconstruct the extraction function at a periodically scheduled rate, or on 
demand, to preserve a desired level of optimality. For example, the extraction 
function can be modified to keep collisions within a predetermined range or 
below a preset threshold. As such, the tradeoff between optimality and 
processing requirements is controlled by the frequency of reconstructing the 
extraction function. Additionally, system 100 provides a dynamically 
changing extraction function and a set of updating policies that allow adjusting 
the processing and memory requirements of a current data set to available 
hardware resources of system 100. 

[0061] The bit selection implemented by mask constructor 106 to create a 

hash function or bit mask can be run offline on a separate processor or 
multiprocessor. The frequency of executing bit selection can affect the 
optimality of the refined rule set. Therefore it is imperative to choose good 
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values for request queue threshold and time-out period that control the 
frequency of optimization. Policy engine 102 that dictates the rule addition or 
deletion actions can also be run on an offline processor. 
[0062] Upon constructing an extraction function, the extraction function is 

used to classify packets in a dynamic system. Referring to FIG. 6, flowchart 

600 represents the general operational flow of an embodiment of the present 
invention. More specifically, flowchart 600 shows an example of a control 
flow for dynamically classifying a packet. 

[0063] Referring to FIG. 6, the control flow of flowchart 600 begins at step 

601 and passes immediately to step 603. At step 603, a packet arrives at key 
extractor 110. At step 606, an extraction function (e.g., hash function (H)) or 
query key is applied to the packet to obtain a packet key. 

[0064] As discussed, mask constructor 106, in an embodiment, produces a 

hash function H as a bit mask (of size k bits) that is used to extract bits from an 
incoming packet. FIG. 7 illustrates the bit extraction operation. At every 
selected bit location p i? the bit mask has a 1 and 0 everywhere else. Key 
extractor 110 applies the bit mask onto an incoming packet (essentially, a 
string of k bits) to extract bits at selected locations and concatenate them to 
form a /-bit wide key. The effectiveness of the hash function depends on how 
representative are the chosen / bit locations. This, in turn, depends on the rule 
set used in classification. 

[0065] Referring back to FIG. 6, at step 609, packet classifier 112 uses the 

packet key to identify a rule that matches the incoming packet. Packet 
classifier 112, in an embodiment, uses a lookup algorithm to match the packet 
key / bit string against the refined rule set located in refined rule memory 108. 
In an embodiment, the fixed length string comparisons are implemented in 
hardware using a Content Addressable Memory (CAM) that allows fast and 
parallel comparisons. Hence, in this embodiment, refined primary memory 
108 is a binary CAM. Each entry (word) in the CAM has an / bit vector and 
match identifier (of x bits wide) of the bucket containing its corresponding 
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rule. The CAM is M words long and / + x bits wide. The packet key obtained 
from the bit extraction is used in the CAM lookup. 

[0066] If, at step 612, no matching rule is found, policy engine 102 is queried 

for disposition instructions. For example, if a new type of packet is first 
presented to packet classifier 112, the packet is classified according to a 
default rule that executes a default action. In an embodiment, packet classifier 
112 obtains the default rule by querying refined rule memory 108. Refined 
rule memory 108 interacts with policy engine 102 to create a new rule so that 
subsequent packets of this type can be handled accordingly. 

[0067] On the other hand, if at step 612, a matching rule is found, the control 

flow passes to step 615. Using the matching rule, packet classifier 112 queries 
policy engine 102 or refined rule memory 108 to select an action to be 
performed on the packet. The action outcome is obtained from a table that 
contains all classification rules. The table can be located in refined rule 
memory 108 or policy engine 102. The rule table is built and updated by 
policy engine 102. The table is updated when the rules set changes, which is 
typically less frequently than the packet arrival rate. Since the execution of the 
action is independent of classification, the control flow ends as indicated at 
step 695. 

[0068] Flowchart 600 is premised on receiving one matching rule at step 615. 

The lookup is a one-cycle operation and the result is a success or failure with 
the appropriate match identifier. For buckets of size 1, CAM lookup returns 
the match identifier associated with the rule. On the other hand, if the buckets 
are of a size greater than 1, the match identifier returns an identifier of the 
bucket because collision has occurred. Therefore, additional processing is 
required to further classify an incoming packet if buckets have more than one 
rule in them. 

[0069] Referring to FIG. 8, flowchart 800 represents the general operational 

flow of another embodiment of the present invention. More specifically, 
flowchart 800 shows an example of a control flow for classifying a packet if 
collision should occur. 
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[0070] Referring to FIG. 8, the control flow of flowchart 800 begins at step 

801 and passes immediately to steps 603-615, as discussed above. At step 803, 
packet classifier 112 identifies a set of rules instead of a single rule. In this 
case, at step 806, packet classifier 112 implements a verification process to 
narrow the rule set by determining which rule within the rule set is the one that 
matches the particular packet. Packet classifier 112 uses the match identifier 
obtained from step 609 to locate the candidate rules that could potentially 
match the packet in consideration. The candidate rules accessed from refined 
rule memory 108 are compared with k bits in the packet either in sequence or 
in parallel. Sequential comparison could be made with a one k bit wide 
comparator. The candidate rules are searched in sequence, and hence would 
take as many as bucket size b cycles. Also, in cases where b can be bound to a 
small value, a group of b such comparators can be provided for faster 
comparison. On the other hand, the candidate rules could be stored in another 
CAM prefixed with the match identifier of the bucket. However, this would 
require a CAM with a large width to store an entire rule along with the bucket 
identifier as a prefix. Though this option is good in terms of clock cycles, it 
may not be cost effective. 

[0071] At step 809, if no matching rule is found, policy engine 102 is queried 

for disposition instructions. On the other hand, if at step 809, a matching rule 
is found, the control flow passes to step 812. Using the matching rule, packet 
classifier 112 queries policy engine 102 or refined rule memory 108 to select 
an action to be performed on the packet. The control flow then ends as 
indicated at step 895. 

[0072] FIGs. 1-8 provide a conceptual illustration of system 100 that allows 

an easy explanation of the present invention. That is, one or more of the blocks 
can be performed by the same piece of hardware or module of software. It 
should also be understood that embodiments of the present invention can be 
implemented in hardware, software, or a combination thereof. In such an 
embodiment, the various components and steps would be implemented in 
hardware and/or software to perform the functions of the present invention. 

SKGFRef.: 1875.0360001 



* 



-20- 

[0073] Various software embodiments are described in terms of the present 

invention. After reading this description, it will become apparent to a person 
skilled in the relevant art(s) how to implement the invention using other 
computer systems and/or computer architectures. 

[0074] In this document, the terms "computer program medium" and 

"computer usable medium" are used to generally refer to media such as a 
removable storage drive, a hard disk installed in hard disk drive, and signals 
(e.g., electronic, electromagnetic, optical, or the like). A removable storage 
drive refers to a floppy disk drive, a magnetic tape drive, an optical disk drive, 
and the like. These computer program products are means for providing 
software to components of system 100, such as mask constructor 106, packet 
classifier 112, key extractor 110, and others. The present invention is directed 
to such computer program products. 

[0075] Computer programs (also called computer control logic) are stored in a 

main memory and/or secondary memory, such as primary rule memory 104, 
refined rule memory 108, and policy engine 102. Computer programs can also 
be received via a communications interface with system 100. Such computer 
programs, when executed, enable system 100 to perform the features of the 
present invention as discussed herein. Accordingly, such computer programs 
represent controllers of system 100. 

[0076] In an embodiment where the invention is implemented using software, 

the software can be stored in a computer program product and loaded into 
system 100 using a removable storage drive, hard drive or communications 
interface with system 100. The control logic (software), when executed by a 
processor (e.g. mask constructor 106, packet classifier 112, or key extractor 
110), causes the processor to perform the functions of the invention as 
described herein. 

[0077] In another embodiment, the invention is implemented primarily in 

hardware using, for example, hardware components such as application 
specific integrated circuits (ASICs). Implementation of the hardware state 
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machine so as to perform the functions described herein will be apparent to 
persons skilled in the relevant art(s). 

[0078] In yet another embodiment, the invention is implemented using a 

combination of both hardware and software 

[0079] While various embodiments of the present invention have been 

described above, it should be understood that they have been presented by way 
of example, and not limitation. It will be apparent to persons skilled in the 
relevant art(s) that various changes in form and detail can be made therein 
without departing from the spirit and scope of the invention. Thus, the present 
invention should not be limited by any of the above-described exemplary 
embodiments, but should be defined only in accordance with the following 
claims and their equivalents. 
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